Music service selection

ABSTRACT

Methods and apparatus for identifying a music service based on a user command. A content type is identified from a received user command and a music service is selected that supports the content type. A selected music service can then transmit audio content associated with the content type for playback.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of priority under 35 U.S.C. § 120to, and is a continuation of, U.S. application Ser. No. 16/780,483(issued as U.S. Pat. No. 11,184,704) filed on Feb. 3, 2020 and entitled“MUSIC SERVICE SELECTION,” which claims priority under 35 U.S.C. § 120to U.S. application Ser. No. 16/154,071 (issued as U.S. Pat. No.10,555,077) filed on Oct. 8, 2018 and entitled “MUSIC SERVICESELECTION,” which claims priority under 35 U.S.C. § 120 to U.S.application Ser. No. 15/098,718 (issued as U.S. Pat. No. 10,097,919)filed on Apr. 14, 2016 and entitled “MUSIC SERVICE SELECTION,” whichclaims priority under 35 USC § 119(e) to U.S. Provisional ApplicationSer. No. 62/298,410 filed on Feb. 22, 2016 and entitled “DEFAULTPLAYBACK DEVICE(S)”, U.S. Provisional Application Ser. No. 62/298,418filed on Feb. 22, 2016 and entitled “AUDIO RESPONSE PLAYBACK”, U.S.Provisional Application Ser. No. 62/298,433 filed on Feb. 22, 2016 andentitled “ROOM-CORRECTED VOICE DETECTION”, U.S. Provisional ApplicationSer. No. 62/298,439 filed on Feb. 22, 2016 and entitled “CONTENTMIXING”, U.S. Provisional Application Ser. No. 62/298,425 filed on Feb.22, 2016 and entitled “MUSIC SERVICE SELECTION”, U.S. ProvisionalApplication Ser. No. 62/298,350 filed on Feb. 22, 2016 and entitled“METADATA EXCHANGE INVOLVING A NETWORKED PLAYBACK SYSTEM AND A NETWORKEDMICROPHONE SYSTEM”, U.S. Provisional Application Ser. No. 62/298,388filed on Feb. 22, 2016 and entitled “HANDLING OF LOSS OF PAIRING BETWEENNETWORKED DEVICES”, U.S. Provisional Application Ser. No. 62/298,393filed on Feb. 22, 2016 and entitled “ACTION BASED ON USER ID”, and U.S.Provisional Application Ser. No. 62/312,350 filed on Mar. 23, 2016 andentitled “VOICE CONTROL OF A MEDIA PLAYBACK SYSTEM”, the contents ofeach of which are herein incorporated by reference in their entireties.

FIELD OF THE DISCLOSURE

The disclosure is related to consumer goods and, more particularly, tomethods, systems, products, features, services, and other elementsdirected to media playback or some aspect thereof.

BACKGROUND

Options for accessing and listening to digital audio in an out-loudsetting were limited until in 2003, when SONOS, Inc. filed for one ofits first patent applications, entitled “Method for Synchronizing AudioPlayback between Multiple Networked Devices,” and began offering a mediaplayback system for sale in 2005. The Sonos Wireless HiFi System enablespeople to experience music from many sources via one or more networkedplayback devices. Through a software control application installed on asmartphone, tablet, or computer, one can play what he or she wants inany room that has a networked playback device. Additionally, using thecontroller, for example, different songs can be streamed to each roomwith a playback device, rooms can be grouped together for synchronousplayback, or the same song can be heard in all rooms synchronously.

Given the ever growing interest in digital media, there continues to bea need to develop consumer-accessible technologies to further enhancethe listening experience.

BRIEF DESCRIPTION OF THE DRAWINGS

Features, aspects, and advantages of the presently disclosed technologymay be better understood with regard to the following description,appended claims, and accompanying drawings where:

FIG. 1 shows an example media playback system configuration in whichcertain embodiments may be practiced;

FIG. 2 shows a functional block diagram of an example playback device;

FIG. 3 shows a functional block diagram of an example control device;

FIG. 4 shows an example controller interface;

FIG. 5 shows an example plurality of network devices;

FIG. 6 shows a function block diagram of an example network microphonedevice;

FIG. 7 is an example flow diagram related to identifying a streamingmusic service via a network microphone device;

FIG. 8 is another example flow diagram related to identifying astreaming music service via a network microphone device;

The drawings are for the purpose of illustrating example embodiments,but it is understood that the inventions are not limited to thearrangements and instrumentality shown in the drawings.

DETAILED DESCRIPTION I. Overview

Embodiments described herein relate to identifying and accessingsuitable streaming services (e.g. streaming audio tracks) based oncommands.

Streaming services may be identified and accessed based upon voicecommands provided by a network microphone device. The network microphonedevice may be a device which receives speech via a microphone andperforms a function based upon the speech. As an example, the microphonenetwork may receive a voice command “play Pandora® 70's rock radio,”determine that the speech is a command play a specific station from aspecific streaming service, and then facilitate the playback of thestation from that service. In other implementations, the selection ofstreaming service may be based upon commands input (e.g. textual input)via a user interface of a controller device. Other types of commands arealso possible.

In another example, the commands may not explicitly specify whichstreaming service a user desires to be accessed. For example, a user mayissue more generic commands such as “play Queen” or “play 70's rock.” Insuch an instance, existing systems are limited in their ability todistinguish what content type a user desires to be played (i.e. theartist or the album Queen, a 70's rock radio station or a “best of”album.) Additionally, such systems are unable to match a user's intendedcontent type to the content type capabilities of the various streamingservices (i.e. which services are capable of playing radio station,artists, albums.)

Given the ever increasing amount of content and number of streamingservices available there is a need for a system that is capable ofintelligently selecting the desired streaming service that matches thecontent type to provide to the user based upon the user command.

In embodiments, selection of the streaming services may be accomplishedby a network configuration including a plurality of network capabledevices. The network configuration may include network microphonedevices, playback devices, computing devices and/or controller devices(e.g. tablet, smartphone) receiving, processing, and analyzing commands.The configuration may further involve retrieving and/or requesting audiocontent from one or more music content servers based on the processingand analysis of the received commands. The audio content then may thenbe obtained by a network microphone device, controller, and/or anynumber of playback devices to provide an audio playback experience basedon the commands. The network configuration may take other forms as well.

In example implementations, selection of a streaming service based on acommand may be determined by a number of criteria, individually or incombination. In one example, the selection of a streaming service may bedependent on the content type (e.g. song, genre, radio station)indicated by the command and whether a particular streaming servicesupports the indicated content type. In such a case, content type logicmay be utilized to correlate the command or portions of the command tocontent types. The content type(s) identified via the logic may then bemapped to a streaming services having the available content types.Analysis of content types indicated via a command may be performed invarious other ways.

In another instance, the selection of a streaming service may be basedin part upon a user history which may take into account a user'sstreaming service preferences. The user preferences may be on a per zonebasis, content type most played, among various other. Additionally,various forms of “external” data may be incorporated, including but notlimited to, geographic, demographic, and weather type data. Other typesof selection influencing criteria may exist.

In addition to selecting a music service to provide audio, theprocessing of the user command may cause alternate indications to beoutput. In such examples, the system may output a suggestion of astreaming service capable of playing a content type indicated by acommand. In another example, the system may output an indication that“the content is unavailable.” Such indications may be output at anetwork microphone device, controller, or at one or more playbackdevices via the network microphone device or controller.

In another aspect, the various selection criteria may serve as inputs ofan algorithm to determine confidence metrics for various streamingservices. A confidence metric may be an indication whether theparticular music service is what the user may desire to listen to. Forexample, the confidence level may be a probability value or percentage(e.g. 1-100) assigned to streaming services. In one example, thestreaming service with the highest confidence metric may be provided forstreaming. In another instance, an error state may be triggered if thehighest calculated confidence metric does not exceed a thresholdconfidence value or if the top N confidence levels are within aspecified range of one another. In such a case, an error state may causethe network microphone device to (1) output an indication that “thecontent is unavailable,” (2) ask the user to repeat/further specify thecommand, (3) cause audio to be played by a preferred partner or defaultservice, among other possibilities. The confidence metric may be used ina variety of many other manners.

While some examples described herein may refer to functions performed bygiven actors such as “users” and/or other entities, it should beunderstood that this is for purposes of explanation only. The claimsshould not be interpreted to require action by any such example actorunless explicitly required by the language of the claims themselves. Itwill be understood by one of ordinary skill in the art that thisdisclosure includes numerous other embodiments.

II. Example Operating Environment

FIG. 1 shows an example configuration of a media playback system 100 inwhich one or more embodiments disclosed herein may be practiced orimplemented. The media playback system 100 as shown is associated withan example home environment having several rooms and spaces, such as forexample, a master bedroom, an office, a dining room, and a living room.As shown in the example of FIG. 1 , the media playback system 100includes playback devices 102-124, control devices 126 and 128, and awired or wireless network router 130.

Further discussions relating to the different components of the examplemedia playback system 100 and how the different components may interactto provide a user with a media experience may be found in the followingsections. While discussions herein may generally refer to the examplemedia playback system 100, technologies described herein are not limitedto applications within, among other things, the home environment asshown in FIG. 1 . For instance, the technologies described herein may beuseful in environments where multi-zone audio may be desired, such as,for example, a commercial setting like a restaurant, mall or airport, avehicle like a sports utility vehicle (SUV), bus or car, a ship or boat,an airplane, and so on.

a. Example Playback Devices

FIG. 2 shows a functional block diagram of an example playback device200 that may be configured to be one or more of the playback devices102-124 of the media playback system 100 of FIG. 1 . The playback device200 may include a processor 202, software components 204, memory 206,audio processing components 208, audio amplifier(s) 210, speaker(s) 212,a network interface 214 including wireless interface(s) 216 and wiredinterface(s) 218, and microphone(s) 220. In one case, the playbackdevice 200 may not include the speaker(s) 212, but rather a speakerinterface for connecting the playback device 200 to external speakers.In another case, the playback device 200 may include neither thespeaker(s) 212 nor the audio amplifier(s) 210, but rather an audiointerface for connecting the playback device 200 to an external audioamplifier or audio-visual receiver.

In one example, the processor 202 may be a clock-driven computingcomponent configured to process input data according to instructionsstored in the memory 206. The memory 206 may be a tangiblecomputer-readable medium configured to store instructions executable bythe processor 202. For instance, the memory 206 may be data storage thatcan be loaded with one or more of the software components 204 executableby the processor 202 to achieve certain functions. In one example, thefunctions may involve the playback device 200 retrieving audio data froman audio source or another playback device. In another example, thefunctions may involve the playback device 200 sending audio data toanother device or playback device on a network. In yet another example,the functions may involve pairing of the playback device 200 with one ormore playback devices to create a multi-channel audio environment.

Certain functions may involve the playback device 200 synchronizingplayback of audio content with one or more other playback devices.During synchronous playback, a listener will preferably not be able toperceive time-delay differences between playback of the audio content bythe playback device 200 and the one or more other playback devices. U.S.Pat. No. 8,234,395 entitled, “System and method for synchronizingoperations among a plurality of independently clocked digital dataprocessing devices,” which is hereby incorporated by reference, providesin more detail some examples for audio playback synchronization amongplayback devices.

The memory 206 may further be configured to store data associated withthe playback device 200, such as one or more zones and/or zone groupsthe playback device 200 is a part of, audio sources accessible by theplayback device 200, or a playback queue that the playback device 200(or some other playback device) may be associated with. The data may bestored as one or more state variables that are periodically updated andused to describe the state of the playback device 200. The memory 206may also include the data associated with the state of the other devicesof the media system, and shared from time to time among the devices sothat one or more of the devices have the most recent data associatedwith the system. Other embodiments are also possible.

The audio processing components 208 may include one or moredigital-to-analog converters (DAC), an audio preprocessing component, anaudio enhancement component or a digital signal processor (DSP), and soon. In one embodiment, one or more of the audio processing components208 may be a subcomponent of the processor 202. In one example, audiocontent may be processed and/or intentionally altered by the audioprocessing components 208 to produce audio signals. The produced audiosignals may then be provided to the audio amplifier(s) 210 foramplification and playback through speaker(s) 212. Particularly, theaudio amplifier(s) 210 may include devices configured to amplify audiosignals to a level for driving one or more of the speakers 212. Thespeaker(s) 212 may include an individual transducer (e.g., a “driver”)or a complete speaker system involving an enclosure with one or moredrivers. A particular driver of the speaker(s) 212 may include, forexample, a subwoofer (e.g., for low frequencies), a mid-range driver(e.g., for middle frequencies), and/or a tweeter (e.g., for highfrequencies). In some cases, each transducer in the one or more speakers212 may be driven by an individual corresponding audio amplifier of theaudio amplifier(s) 210. In addition to producing analog signals forplayback by the playback device 200, the audio processing components 208may be configured to process audio content to be sent to one or moreother playback devices for playback.

Audio content to be processed and/or played back by the playback device200 may be received from an external source, such as via an audioline-in input connection (e.g., an auto-detecting 3.5 mm audio line-inconnection) or the network interface 214.

The network interface 214 may be configured to facilitate a data flowbetween the playback device 200 and one or more other devices on a datanetwork. As such, the playback device 200 may be configured to receiveaudio content over the data network from one or more other playbackdevices in communication with the playback device 200, network deviceswithin a local area network, or audio content sources over a wide areanetwork such as the Internet. In one example, the audio content andother signals transmitted and received by the playback device 200 may betransmitted in the form of digital packet data containing an InternetProtocol (IP)-based source address and IP-based destination addresses.In such a case, the network interface 214 may be configured to parse thedigital packet data such that the data destined for the playback device200 is properly received and processed by the playback device 200.

As shown, the network interface 214 may include wireless interface(s)216 and wired interface(s) 218. The wireless interface(s) 216 mayprovide network interface functions for the playback device 200 towirelessly communicate with other devices (e.g., other playbackdevice(s), speaker(s), receiver(s), network device(s), control device(s)within a data network the playback device 200 is associated with) inaccordance with a communication protocol (e.g., any wireless standardincluding IEEE 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.15, 4Gmobile communication standard, and so on). The wired interface(s) 218may provide network interface functions for the playback device 200 tocommunicate over a wired connection with other devices in accordancewith a communication protocol (e.g., IEEE 802.3). While the networkinterface 214 shown in FIG. 2 includes both wireless interface(s) 216and wired interface(s) 218, the network interface 214 may in someembodiments include only wireless interface(s) or only wiredinterface(s).

The microphone(s) 220 may be arranged to detect sound in the environmentof the playback device 200. For instance, the microphone(s) may bemounted on an exterior wall of a housing of the playback device. Themicrophone(s) may be any type of microphone now known or later developedsuch as a condenser microphone, electret condenser microphone, or adynamic microphone. The microphone(s) may be sensitive to a portion ofthe frequency range of the speaker(s) 220. One or more of the speaker(s)220 may operate in reverse as the microphone(s) 220. In some aspects,the playback device 200 might not have microphone(s) 220.

In one example, the playback device 200 and one other playback devicemay be paired to play two separate audio components of audio content.For instance, playback device 200 may be configured to play a leftchannel audio component, while the other playback device may beconfigured to play a right channel audio component, thereby producing orenhancing a stereo effect of the audio content. The paired playbackdevices (also referred to as “bonded playback devices”) may further playaudio content in synchrony with other playback devices.

In another example, the playback device 200 may be sonicallyconsolidated with one or more other playback devices to form a single,consolidated playback device. A consolidated playback device may beconfigured to process and reproduce sound differently than anunconsolidated playback device or playback devices that are paired,because a consolidated playback device may have additional speakerdrivers through which audio content may be rendered. For instance, ifthe playback device 200 is a playback device designed to render lowfrequency range audio content (i.e. a subwoofer), the playback device200 may be consolidated with a playback device designed to render fullfrequency range audio content. In such a case, the full frequency rangeplayback device, when consolidated with the low frequency playbackdevice 200, may be configured to render only the mid and high frequencycomponents of audio content, while the low frequency range playbackdevice 200 renders the low frequency component of the audio content. Theconsolidated playback device may further be paired with a singleplayback device or yet another consolidated playback device.

By way of illustration, SONOS, Inc. presently offers (or has offered)for sale certain playback devices including a “PLAY:1,” “PLAY:3,”“PLAY:5,” “PLAYBAR,” “CONNECT:AMP,” “CONNECT,” and “SUB.” Any otherpast, present, and/or future playback devices may additionally oralternatively be used to implement the playback devices of exampleembodiments disclosed herein. Additionally, it is understood that aplayback device is not limited to the example illustrated in FIG. 2 orto the SONOS product offerings. For example, a playback device mayinclude a wired or wireless headphone. In another example, a playbackdevice may include or interact with a docking station for personalmobile media playback devices. In yet another example, a playback devicemay be integral to another device or component such as a television, alighting fixture, or some other device for indoor or outdoor use.

b. Example Playback Zone Configurations

Referring back to the media playback system 100 of FIG. 1 , theenvironment may have one or more playback zones, each with one or moreplayback devices. The media playback system 100 may be established withone or more playback zones, after which one or more zones may be added,or removed to arrive at the example configuration shown in FIG. 1 . Eachzone may be given a name according to a different room or space such asan office, bathroom, master bedroom, bedroom, kitchen, dining room,living room, and/or balcony. In one case, a single playback zone mayinclude multiple rooms or spaces. In another case, a single room orspace may include multiple playback zones.

As shown in FIG. 1 , the balcony, dining room, kitchen, bathroom,office, and bedroom zones each have one playback device, while theliving room and master bedroom zones each have multiple playbackdevices. In the living room zone, playback devices 104, 106, 108, and110 may be configured to play audio content in synchrony as individualplayback devices, as one or more bonded playback devices, as one or moreconsolidated playback devices, or any combination thereof. Similarly, inthe case of the master bedroom, playback devices 122 and 124 may beconfigured to play audio content in synchrony as individual playbackdevices, as a bonded playback device, or as a consolidated playbackdevice.

In one example, one or more playback zones in the environment of FIG. 1may each be playing different audio content. For instance, the user maybe grilling in the balcony zone and listening to hip hop music beingplayed by the playback device 102 while another user may be preparingfood in the kitchen zone and listening to classical music being playedby the playback device 114. In another example, a playback zone may playthe same audio content in synchrony with another playback zone. Forinstance, the user may be in the office zone where the playback device118 is playing the same rock music that is being playing by playbackdevice 102 in the balcony zone. In such a case, playback devices 102 and118 may be playing the rock music in synchrony such that the user mayseamlessly (or at least substantially seamlessly) enjoy the audiocontent that is being played out-loud while moving between differentplayback zones. Synchronization among playback zones may be achieved ina manner similar to that of synchronization among playback devices, asdescribed in previously referenced U.S. Pat. No. 8,234,395.

As suggested above, the zone configurations of the media playback system100 may be dynamically modified, and in some embodiments, the mediaplayback system 100 supports numerous configurations. For instance, if auser physically moves one or more playback devices to or from a zone,the media playback system 100 may be reconfigured to accommodate thechange(s). For instance, if the user physically moves the playbackdevice 102 from the balcony zone to the office zone, the office zone maynow include both the playback device 118 and the playback device 102.The playback device 102 may be paired or grouped with the office zoneand/or renamed if so desired via a control device such as the controldevices 126 and 128. On the other hand, if the one or more playbackdevices are moved to a particular area in the home environment that isnot already a playback zone, a new playback zone may be created for theparticular area.

Further, different playback zones of the media playback system 100 maybe dynamically combined into zone groups or split up into individualplayback zones. For instance, the dining room zone and the kitchen zone114 may be combined into a zone group for a dinner party such thatplayback devices 112 and 114 may render audio content in synchrony. Onthe other hand, the living room zone may be split into a television zoneincluding playback device 104, and a listening zone including playbackdevices 106, 108, and 110, if the user wishes to listen to music in theliving room space while another user wishes to watch television.

c. Example Control Devices

FIG. 3 shows a functional block diagram of an example control device 300that may be configured to be one or both of the control devices 126 and128 of the media playback system 100. As shown, the control device 300may include a processor 302, memory 304, a network interface 306, a userinterface 308, microphone(s) 310, and software components 312. In oneexample, the control device 300 may be a dedicated controller for themedia playback system 100. In another example, the control device 300may be a network device on which media playback system controllerapplication software may be installed, such as for example, an iPhone™,iPad™ or any other smart phone, tablet or network device (e.g., anetworked computer such as a PC or Mac™).

The processor 302 may be configured to perform functions relevant tofacilitating user access, control, and configuration of the mediaplayback system 100. The memory 304 may be data storage that can beloaded with one or more of the software components executable by theprocessor 302 to perform those functions. The memory 304 may also beconfigured to store the media playback system controller applicationsoftware and other data associated with the media playback system 100and the user.

In one example, the network interface 306 may be based on an industrystandard (e.g., infrared, radio, wired standards including IEEE 802.3,wireless standards including IEEE 802.11a, 802.11b, 802.11g, 802.11n,802.11ac, 802.15, 4G mobile communication standard, and so on). Thenetwork interface 306 may provide a means for the control device 300 tocommunicate with other devices in the media playback system 100. In oneexample, data and information (e.g., such as a state variable) may becommunicated between control device 300 and other devices via thenetwork interface 306. For instance, playback zone and zone groupconfigurations in the media playback system 100 may be received by thecontrol device 300 from a playback device or another network device, ortransmitted by the control device 300 to another playback device ornetwork device via the network interface 306. In some cases, the othernetwork device may be another control device.

Playback device control commands such as volume control and audioplayback control may also be communicated from the control device 300 toa playback device via the network interface 306. As suggested above,changes to configurations of the media playback system 100 may also beperformed by a user using the control device 300. The configurationchanges may include adding/removing one or more playback devices to/froma zone, adding/removing one or more zones to/from a zone group, forminga bonded or consolidated player, separating one or more playback devicesfrom a bonded or consolidated player, among others. Accordingly, thecontrol device 300 may sometimes be referred to as a controller, whetherthe control device 300 is a dedicated controller or a network device onwhich media playback system controller application software isinstalled.

Control device 300 may include microphone(s) 310. Microphone(s) 310 maybe arranged to detect sound in the environment of the control device300. Microphone(s) 310 may be any type of microphone now known or laterdeveloped such as a condenser microphone, electret condenser microphone,or a dynamic microphone. The microphone(s) may be sensitive to a portionof a frequency range. Two or more microphones 310 may be arranged tocapture location information of an audio source (e.g., voice, audiblesound) and/or to assist in filtering background noise.

The user interface 308 of the control device 300 may be configured tofacilitate user access and control of the media playback system 100, byproviding a controller interface such as the controller interface 400shown in FIG. 4 . The controller interface 400 includes a playbackcontrol region 410, a playback zone region 420, a playback status region430, a playback queue region 440, and an audio content sources region450. The user interface 400 as shown is just one example of a userinterface that may be provided on a network device such as the controldevice 300 of FIG. 3 (and/or the control devices 126 and 128 of FIG. 1 )and accessed by users to control a media playback system such as themedia playback system 100. Other user interfaces of varying formats,styles, and interactive sequences may alternatively be implemented onone or more network devices to provide comparable control access to amedia playback system.

The playback control region 410 may include selectable (e.g., by way oftouch or by using a cursor) icons to cause playback devices in aselected playback zone or zone group to play or pause, fast forward,rewind, skip to next, skip to previous, enter/exit shuffle mode,enter/exit repeat mode, enter/exit cross fade mode. The playback controlregion 410 may also include selectable icons to modify equalizationsettings, and playback volume, among other possibilities.

The playback zone region 420 may include representations of playbackzones within the media playback system 100. In some embodiments, thegraphical representations of playback zones may be selectable to bringup additional selectable icons to manage or configure the playback zonesin the media playback system, such as a creation of bonded zones,creation of zone groups, separation of zone groups, and renaming of zonegroups, among other possibilities.

For example, as shown, a “group” icon may be provided within each of thegraphical representations of playback zones. The “group” icon providedwithin a graphical representation of a particular zone may be selectableto bring up options to select one or more other zones in the mediaplayback system to be grouped with the particular zone. Once grouped,playback devices in the zones that have been grouped with the particularzone will be configured to play audio content in synchrony with theplayback device(s) in the particular zone. Analogously, a “group” iconmay be provided within a graphical representation of a zone group. Inthis case, the “group” icon may be selectable to bring up options todeselect one or more zones in the zone group to be removed from the zonegroup. Other interactions and implementations for grouping andungrouping zones via a user interface such as the user interface 400 arealso possible. The representations of playback zones in the playbackzone region 420 may be dynamically updated as playback zone or zonegroup configurations are modified.

The playback status region 430 may include graphical representations ofaudio content that is presently being played, previously played, orscheduled to play next in the selected playback zone or zone group. Theselected playback zone or zone group may be visually distinguished onthe user interface, such as within the playback zone region 420 and/orthe playback status region 430. The graphical representations mayinclude track title, artist name, album name, album year, track length,and other relevant information that may be useful for the user to knowwhen controlling the media playback system via the user interface 400.

The playback queue region 440 may include graphical representations ofaudio content in a playback queue associated with the selected playbackzone or zone group. In some embodiments, each playback zone or zonegroup may be associated with a playback queue containing informationcorresponding to zero or more audio items for playback by the playbackzone or zone group. For instance, each audio item in the playback queuemay comprise a uniform resource identifier (URI), a uniform resourcelocator (URL) or some other identifier that may be used by a playbackdevice in the playback zone or zone group to find and/or retrieve theaudio item from a local audio content source or a networked audiocontent source, possibly for playback by the playback device.

In one example, a playlist may be added to a playback queue, in whichcase information corresponding to each audio item in the playlist may beadded to the playback queue. In another example, audio items in aplayback queue may be saved as a playlist. In a further example, aplayback queue may be empty, or populated but “not in use” when theplayback zone or zone group is playing continuously streaming audiocontent, such as Internet radio that may continue to play untilotherwise stopped, rather than discrete audio items that have playbackdurations. In an alternative embodiment, a playback queue can includeInternet radio and/or other streaming audio content items and be “inuse” when the playback zone or zone group is playing those items. Otherexamples are also possible.

When playback zones or zone groups are “grouped” or “ungrouped,”playback queues associated with the affected playback zones or zonegroups may be cleared or re-associated. For example, if a first playbackzone including a first playback queue is grouped with a second playbackzone including a second playback queue, the established zone group mayhave an associated playback queue that is initially empty, that containsaudio items from the first playback queue (such as if the secondplayback zone was added to the first playback zone), that contains audioitems from the second playback queue (such as if the first playback zonewas added to the second playback zone), or a combination of audio itemsfrom both the first and second playback queues. Subsequently, if theestablished zone group is ungrouped, the resulting first playback zonemay be re-associated with the previous first playback queue, or beassociated with a new playback queue that is empty or contains audioitems from the playback queue associated with the established zone groupbefore the established zone group was ungrouped. Similarly, theresulting second playback zone may be re-associated with the previoussecond playback queue, or be associated with a new playback queue thatis empty, or contains audio items from the playback queue associatedwith the established zone group before the established zone group wasungrouped. Other examples are also possible.

Referring back to the user interface 400 of FIG. 4 , the graphicalrepresentations of audio content in the playback queue region 440 mayinclude track titles, artist names, track lengths, and other relevantinformation associated with the audio content in the playback queue. Inone example, graphical representations of audio content may beselectable to bring up additional selectable icons to manage and/ormanipulate the playback queue and/or audio content represented in theplayback queue. For instance, a represented audio content may be removedfrom the playback queue, moved to a different position within theplayback queue, or selected to be played immediately, or after anycurrently playing audio content, among other possibilities. A playbackqueue associated with a playback zone or zone group may be stored in amemory on one or more playback devices in the playback zone or zonegroup, on a playback device that is not in the playback zone or zonegroup, and/or some other designated device.

The audio content sources region 450 may include graphicalrepresentations of selectable audio content sources from which audiocontent may be retrieved and played by the selected playback zone orzone group. Discussions pertaining to audio content sources may be foundin the following section.

d. Example Audio Content Sources

As indicated previously, one or more playback devices in a zone or zonegroup may be configured to retrieve for playback audio content (e.g.according to a corresponding URI or URL for the audio content) from avariety of available audio content sources. In one example, audiocontent may be retrieved by a playback device directly from acorresponding audio content source (e.g., a line-in connection). Inanother example, audio content may be provided to a playback device overa network via one or more other playback devices or network devices.

Example audio content sources may include a memory of one or moreplayback devices in a media playback system such as the media playbacksystem 100 of FIG. 1 , local music libraries on one or more networkdevices (such as a control device, a network-enabled personal computer,or a networked-attached storage (NAS), for example), streaming audioservices providing audio content via the Internet (e.g., the cloud), oraudio sources connected to the media playback system via a line-in inputconnection on a playback device or network devise, among otherpossibilities.

In some embodiments, audio content sources may be regularly added orremoved from a media playback system such as the media playback system100 of FIG. 1 . In one example, an indexing of audio items may beperformed whenever one or more audio content sources are added, removedor updated. Indexing of audio items may involve scanning foridentifiable audio items in all folders/directory shared over a networkaccessible by playback devices in the media playback system, andgenerating or updating an audio content database containing metadata(e.g., title, artist, album, track length, among others) and otherassociated information, such as a URI or URL for each identifiable audioitem found. Other examples for managing and maintaining audio contentsources may also be possible.

The above discussions relating to playback devices, controller devices,playback zone configurations, and media content sources provide onlysome examples of operating environments within which functions andmethods described below may be implemented. Other operating environmentsand configurations of media playback systems, playback devices, andnetwork devices not explicitly described herein may also be applicableand suitable for implementation of the functions and methods.

e. Example Plurality of Networked Devices

FIG. 5 shows an example plurality of devices 500 that may be configuredto provide an audio playback experience based on voice control. Onehaving ordinary skill in the art will appreciate that the devices shownin FIG. 5 are for illustrative purposes only, and variations includingdifferent and/or additional devices may be possible. As shown, theplurality of devices 500 includes computing devices 504, 506, and 508;network microphone devices (NMDs) 512, 514, and 516; playback devices(PBDs) 532, 534, 536, and 538; and a controller device (CR) 522.

Each of the plurality of devices 500 may be network-capable devices thatcan establish communication with one or more other devices in theplurality of devices according to one or more network protocols, such asNFC, Bluetooth, Ethernet, and IEEE 802.11, among other examples, overone or more types of networks, such as wide area networks (WAN), localarea networks (LAN), and personal area networks (PAN), among otherpossibilities.

As shown, the computing devices 504, 506, and 508 may be part of a cloudnetwork 502. The cloud network 502 may include additional computingdevices. In one example, the computing devices 504, 506, and 508 may bedifferent servers. In another example, two or more of the computingdevices 504, 506, and 508 may be modules of a single server.Analogously, each of the computing device 504, 506, and 508 may includeone or more modules or servers. For ease of illustration purposesherein, each of the computing devices 504, 506, and 508 may beconfigured to perform particular functions within the cloud network 502.For instance, computing device 508 may be a source of audio content fora streaming music service.

As shown, the computing device 504 may be configured to interface withNMDs 512, 514, and 516 via communication path 542. NMDs 512, 514, and516 may be components of one or more “Smart Home” systems. In one case,NMDs 512, 514, and 516 may be physically distributed throughout ahousehold, similar to the distribution of devices shown in FIG. 1 . Inanother case, two or more of the NMDs 512, 514, and 516 may bephysically positioned within relative close proximity of one another.Communication path 542 may comprise one or more types of networks, suchas a WAN including the Internet, LAN, and/or PAN, among otherpossibilities.

In one example, one or more of the NMDs 512, 514, and 516 may be devicesconfigured primarily for audio detection. In another example, one ormore of the NMDs 512, 514, and 516 may be components of devices havingvarious primary utilities. For instance, as discussed above inconnection to FIGS. 2 and 3 , one or more of NMDs 512, 514, and 516 maybe the microphone(s) 220 of playback device 200 or the microphone(s) 310of network device 300. Further, in some cases, one or more of NMDs 512,514, and 516 may be the playback device 200 or network device 300. In anexample, one or more of NMDs 512, 514, and/or 516 may include multiplemicrophones arranged in a microphone array.

As shown, the computing device 506 may be configured to interface withCR 522 and PBDs 532, 534, 536, and 538 via communication path 544. Inone example, CR 522 may be a network device such as the network device200 of FIG. 2 . Accordingly, CR 522 may be configured to provide thecontroller interface 400 of FIG. 4 . Similarly, PBDs 532, 534, 536, and538 may be playback devices such as the playback device 300 of FIG. 3 .As such, PBDs 532, 534, 536, and 538 may be physically distributedthroughout a household as shown in FIG. 1 . For illustration purposes,PBDs 536 and 538 may be part of a bonded zone 530, while PBDs 532 and534 may be part of their own respective zones. As described above, thePBDs 532, 534, 536, and 538 may be dynamically bonded, grouped,unbonded, and ungrouped. Communication path 544 may comprise one or moretypes of networks, such as a WAN including the Internet, LAN, and/orPAN, among other possibilities.

In one example, as with NMDs 512, 514, and 516, CR522 and PBDs 532, 534,536, and 538 may also be components of one or more “Smart Home” systems.In one case, PBDs 532, 534, 536, and 538 may be distributed throughoutthe same household as the NMDs 512, 514, and 516. Further, as suggestedabove, one or more of PBDs 532, 534, 536, and 538 may be one or more ofNMDs 512, 514, and 516.

The NMDs 512, 514, and 516 may be part of a local area network, and thecommunication path 542 may include an access point that links the localarea network of the NMDs 512, 514, and 516 to the computing device 504over a WAN (communication path not shown). Likewise, each of the NMDs512, 514, and 516 may communicate with each other via such an accesspoint.

Similarly, CR 522 and PBDs 532, 534, 536, and 538 may be part of a localarea network and/or a local playback network as discussed in previoussections, and the communication path 544 may include an access pointthat links the local area network and/or local playback network of CR522 and PBDs 532, 534, 536, and 538 to the computing device 506 over aWAN. As such, each of the CR 522 and PBDs 532, 534, 536, and 538 mayalso communicate with each over such an access point.

In one example, communication paths 542 and 544 may comprise the sameaccess point. In an example, each of the NMDs 512, 514, and 516, CR 522,and PBDs 532, 534, 536, and 538 may access the cloud network 502 via thesame access point for a household.

As shown in FIG. 5 , each of the NMDs 512, 514, and 516, CR 522, andPBDs 532, 534, 536, and 538 may also directly communicate with one ormore of the other devices via communication means 546. Communicationmeans 546 as described herein may involve one or more forms ofcommunication between the devices, according to one or more networkprotocols, over one or more types of networks, and/or may involvecommunication via one or more other network devices. For instance,communication means 546 may include one or more of for example,Bluetooth™ (IEEE 802.15), NFC, Wireless direct, and/or Proprietarywireless, among other possibilities.

In one example, CR 522 may communicate with NMD 512 over Bluetooth™, andcommunicate with PBD 534 over another local area network. In anotherexample, NMD 514 may communicate with CR 522 over another local areanetwork, and communicate with PBD 536 over Bluetooth. In a furtherexample, each of the PBDs 532, 534, 536, and 538 may communicate witheach other according to a spanning tree protocol over a local playbacknetwork, while each communicating with CR 522 over a local area network,different from the local playback network. Other examples are alsopossible.

In some cases, communication means between the NMDs 512, 514, and 516,CR 522, and PBDs 532, 534, 536, and 538 may change depending on types ofcommunication between the devices, network conditions, and/or latencydemands. For instance, communication means 546 may be used when NMD 516is first introduced to the household with the PBDs 532, 534, 536, and538. In one case, the NMD 516 may transmit identification informationcorresponding to the NMD 516 to PBD 538 via NFC, and PBD 538 may inresponse, transmit local area network information to NMD 516 via NFC (orsome other form of communication). However, once NMD 516 has beenconfigured within the household, communication means between NMD 516 andPBD 538 may change. For instance, NMD 516 may subsequently communicatewith PBD 538 via communication path 542, the cloud network 502, andcommunication path 544. In another example, the NMDs and PBDs may nevercommunicate via local communications means 546. In a further example,the NMDs and PBDs may communicate primarily via local communicationsmeans 546. Other examples are also possible.

In an illustrative example, NMDs 512, 514, and 516 may be configured toreceive voice inputs to control PBDs 532, 534, 536, and 538. Theavailable control commands may include any media playback systemcontrols previously discussed, such as playback volume control, playbacktransport controls, music source selection, and grouping, among otherpossibilities. In one instance, NMD 512 may receive a voice input tocontrol one or more of the PBDs 532, 534, 536, and 538. In response toreceiving the voice input, NMD 512 may transmit via communication path542, the voice input to computing device 504 for processing. In oneexample, the computing device 504 may convert the voice input to anequivalent text command, and parse the text command to identify acommand. Computing device 504 may then subsequently transmit the textcommand to the computing device 506. In another example, the computingdevice 504 may convert the voice input to an equivalent text command,and then subsequently transmit the text command to the computing device506. The computing device 506 may then parse the text command toidentify one or more playback commands.

For instance, if the text command is “Play ‘Track 1’ by ‘Artist 1’ from‘Streaming Service 1’ in ‘Zone 1’,” The computing device 506 mayidentify (i) a URL for “Track 1” by “Artist 1” available from “StreamingService 1,” and (ii) at least one playback device in “Zone 1.” In thisexample, the URL for “Track 1” by “Artist 1” from “Streaming Service 1”may be a URL pointing to computing device 508, and “Zone 1” may be thebonded zone 530. As such, upon identifying the URL and one or both ofPBDs 536 and 538, the computing device 506 may transmit viacommunication path 544 to one or both of PBDs 536 and 538, theidentified URL for playback. One or both of PBDs 536 and 538 mayresponsively retrieve audio content from the computing device 508according to the received URL, and begin playing “Track 1” by “Artist 1”from “Streaming Service 1.”

One having ordinary skill in the art will appreciate that the above isjust one illustrative example, and that other implementations are alsopossible. In one case, operations performed by one or more of theplurality of devices 500, as described above, may be performed by one ormore other devices in the plurality of device 500. For instance, theconversion from voice input to the text command may be alternatively,partially, or wholly performed by another device or devices, such as NMD512, computing device 506, PBD 536, and/or PBD 538. Analogously, theidentification of the URL may be alternatively, partially, or whollyperformed by another device or devices, such as NMD 512, computingdevice 504, PBD 536, and/or PBD 538.

f. Example Network Microphone Device

FIG. 6 shows a function block diagram of an example network microphonedevice 600 that may be configured to be one or more of NMDs 512, 514,and 516 of FIG. 5 . As shown, the network microphone device 600 includesa processor 602, memory 604, a microphone array 606, a network interface608, a user interface 610, software components 612, and speaker(s) 614.One having ordinary skill in the art will appreciate that other networkmicrophone device configurations and arrangements are also possible. Forinstance, network microphone devices may alternatively exclude thespeaker(s) 614 or have a single microphone instead of microphone array606.

The processor 602 may include one or more processors and/or controllers,which may take the form of a general or special-purpose processor orcontroller. For instance, the processing unit 602 may includemicroprocessors, microcontrollers, application-specific integratedcircuits, digital signal processors, and the like. The memory 604 may bedata storage that can be loaded with one or more of the softwarecomponents executable by the processor 602 to perform those functions.Accordingly, memory 604 may comprise one or more non-transitorycomputer-readable storage mediums, examples of which may includevolatile storage mediums such as random access memory, registers, cache,etc. and non-volatile storage mediums such as read-only memory, ahard-disk drive, a solid-state drive, flash memory, and/or anoptical-storage device, among other possibilities.

The microphone array 606 may be a plurality of microphones arranged todetect sound in the environment of the network microphone device 600.Microphone array 606 may include any type of microphone now known orlater developed such as a condenser microphone, electret condensermicrophone, or a dynamic microphone, among other possibilities. In oneexample, the microphone array may be arranged to detect audio from oneor more directions relative to the network microphone device. Themicrophone array 606 may be sensitive to a portion of a frequency range.In one example, a first subset of the microphone array 606 may besensitive to a first frequency range, while a second subset of themicrophone array may be sensitive to a second frequency range. Themicrophone array 606 may further be arranged to capture locationinformation of an audio source (e.g., voice, audible sound) and/or toassist in filtering background noise. Notably, in some embodiments themicrophone array may consist of only a single microphone, rather than aplurality of microphones.

The network interface 608 may be configured to facilitate wirelessand/or wired communication between various network devices, such as, inreference to FIG. 5 , CR 522, PBDs 532-538, computing device 504-508 incloud network 502, and other network microphone devices, among otherpossibilities. As such, network interface 608 may take any suitable formfor carrying out these functions, examples of which may include anEthernet interface, a serial bus interface (e.g., FireWire, USB 2.0,etc.), a chipset and antenna adapted to facilitate wirelesscommunication, and/or any other interface that provides for wired and/orwireless communication. In one example, the network interface 608 may bebased on an industry standard (e.g., infrared, radio, wired standardsincluding IEEE 802.3, wireless standards including IEEE 802.11a,802.11b, 802.11g, 802.11n, 802.11ac, 802.15, 4G mobile communicationstandard, and so on).

The user interface 610 of the network microphone device 600 may beconfigured to facilitate user interactions with the network microphonedevice. In one example, the user interface 608 may include one or moreof physical buttons, graphical interfaces provided on touch sensitivescreen(s) and/or surface(s), among other possibilities, for a user todirectly provide input to the network microphone device 600. The userinterface 610 may further include one or more of lights and thespeaker(s) 614 to provide visual and/or audio feedback to a user. In oneexample, the network microphone device 600 may further be configured toplayback audio content via the speaker(s) 614.

III. Example Methods

As discussed above, embodiments described herein may involve identifyingand accessing suitable streaming services (e.g. streaming audio tracks)based on commands.

Methods 700 and 800 shown in FIGS. 7 and 8 present embodiments ofmethods that can be implemented within an operating environmentinvolving, for example, the media playback system 100 of FIG. 1 , one ormore of the playback device 200 of FIG. 2 , and one or more of thecontrol device 300 of FIG. 3 . Methods 700 and 800 may include one ormore operations, functions, or actions as illustrated by one or more ofblocks 702-714 and 802-808. Although the blocks are illustrated insequential order, these blocks may also be performed in parallel, and/orin a different order than those described herein. Also, the variousblocks may be combined into fewer blocks, divided into additionalblocks, and/or removed based upon the desired implementation.

In addition, for the methods 700, 800, and other processes and methodsdisclosed herein, the flowchart shows functionality and operation of onepossible implementation of present embodiments. In this regard, eachblock may represent a module, a segment, or a portion of program code,which includes one or more instructions executable by a processor forimplementing specific logical functions or steps in the process. Theprogram code may be stored on any type of computer readable medium, forexample, such as a storage device including a disk or hard drive. Thecomputer readable medium may include non-transitory computer readablemedium, for example, such as computer-readable media that stores datafor short periods of time like register memory, processor cache andRandom Access Memory (RAM). The computer readable medium may alsoinclude non-transitory media, such as secondary or persistent long termstorage, like read only memory (ROM), optical or magnetic disks,compact-disc read only memory (CD-ROM), for example. The computerreadable media may also be any other volatile or non-volatile storagesystems. The computer readable medium may be considered a computerreadable storage medium, for example, or a tangible storage device. Inaddition, for the methods 700, 800 and other processes and methodsdisclosed herein, each block in FIGS. 5 and 6 may represent circuitrythat is wired to perform the specific logical functions in the process.

FIG. 7 is an example flow diagram related to a process for identifying amusic service for streaming.

At 702, NMDs 512-516 or CR 522 may receive an indication of a commandwhich may indicate audio content to be provided for playback from astreaming service. In some instances, a command received by NMDs 512-516may take the form of a voice command, whereas a command received by CR522 may be a textual command input on a user interface.

Typically, the received command may include information relating to oneor more audio content types. In some cases, the command may include thename of an artist, song, album, or genre (i.e. “play Led Zeppelin,”“play 70's rock”.) Additionally, the command may include pre-fix and/orsuffix type information (e.g. “best of . . . ,” “ . . . radio,” “ . . .playlist”) that may be further indicative of content type. For example,a command “play Led Zeppelin radio” may indicate a user's desire tolisten to a specific artist's music in a radio format. The receivedcommand may include various other forms of information indicative ofcontent type as well.

The received indication of a command at 702 may be processed in variousways. In one implementation, the processing of a command may beaccomplished via cloud network 502. In such a case, a voice commandreceived by NMDs 512-516 may cause the voice input to be transmitted viacommunication network 546 to one or more of computing device 504-508 forprocessing. The cloud computing device may convert the voice input to anequivalent text command and parse the text command to identify thecommand. In another configuration the cloud computing device may onlyconvert the voice input to an equivalent text format and send theequivalent text to a second computing device for parsing and commandidentification. In other instances, the NMDs 512-516 may convert thevoice input to text prior to transmission via communication network 546or both convert a voice input to text and perform the parsing toidentify the command. In the case of CR 522 receiving a textual command,the text input may be transmitted via communication network 546 to oneof computing devices 504-508 for parsing and command identification. Inanother instance, CR 522 may perform the parsing of the text input toidentify the command.

In another implementation, the processing of a command may beaccomplished locally over a local network. In such a case, a voicecommand received by NMDs 512-516 may cause the voice input to betransmitted via a local network to one or more local computing devicesfor processing. The local computing device may convert the voice inputto an equivalent text command and parse the text command to identify thecommand. In another configuration local computing device may onlyconvert the voice input to equivalent text format and send the theequivalent text format to a second local computing device for parsingand command identification. In other instances, the NMDs 512-16 mayconvert the voice input to text prior to transmission via the localnetwork or both convert a voice input to text and perform the parsing toidentify the command. In the case of CR 522 receiving a textual command,the text input may be transmitted via the local network to a localcomputing device for parsing and command identification. In anotherinstance, CR 522 may perform the parsing of the text input to identifythe command. Other configurations for processing a command may exist.

At 704, a computing device may identify a content type indicated by thecommand. The identification of content type may be accomplished viacloud network 502 or locally over a local network.

In one implementation a computing device may use content type logic tocorrelate the commands or portions of the commands to content type(s).Using the aforementioned example of “Play Led Zeppelin radio,” acomputing device may identify the content type as “Artist/RadioStation.” In another example, the command “Play Electronic Dance Music”may cause the content type to be identified as “Genre.” Similaridentifications may be made for the various other content types. Theidentification of content type may be accomplished for instance throughinputting a keyword of the command such as “Dance Music” and thedatabase may map the keyword to an indication for content type such asthe Genre. The database may reside on the computing device or on thenetwork microphone device in some examples.

If it is determined that no content type is identified at 708 the methodmay proceed directly to 714. A content type may be unidentifiable for anumber of reasons including user input error, poor speech input quality,background noise, or simply no such content type is known. For example,the content type of a command indicating an obscure artist name may beunable to be identified.

At 714, an indication may be output by a computing device andtransmitted via the communication network 546 to any or all of NMDs512-516, PBDs 532-538, or CR 522 indicating that “the content isunavailable”. The indication that no content is available may then bepresented audibly or visually to a user. For example, the NMDs and PBDsmay output audible indications, whereas the CR may be capable ofoutputting both audible and visual indications. The indication sent may,additionally or alternatively, cause a suggestion to be output to a userinstructing he or she to re-input the command. For instance, thesuggestion might be for the user to specify some additional identifyingcharacteristic so as to assist in identifying the content type.

However, if it is determined at 706 that a content type has beenidentified the method may proceed to 708 to identify a streaming servicethat is able to play the content type identified at 704. Generally,particular streaming services may vary significantly from otherstreaming services not only in what audio content they provide but alsoin how they present the content. For instance, each streaming servicemay possess relatively exclusive rights to stream the music content ofcertain artists or albums. In another instance, some streaming services,such as Pandora®, may only stream in radio station format, whereasothers like Spotify® may be capable of streaming music on demand byartist, song, album, or radio station. In view of this fact, it isapparent that not all streaming services may be capable of streaming acontent type identified at 704.

In one instance, a computing device may identify a suitable streamingservice by comparing metadata of the identified content type to alook-up table(s) that may contain entries for the content available andin what format the content is capable of being provisioned for variousstreaming services. In some cases, the computing device may direct thequery to the entire universe of streaming services available. In othercases, the computing device may only query a sub-set of availablestreaming services. Such a sub-set may be chosen by the computing devicebased on a number of factors alone or in combination including streamingservices a user is registered with, the amount of days since a user haslast used a streaming service, streaming service popularity, usersettings, among others. For example, if a user has only registered withPandora®, Spotify®, and Deezer®, the computing device may only querythose streaming services to determine which are suitable.

Such look-up table(s) may be stored in memory on a computing device orat an external location such as the computing device or at the musicservice. Given that the various look-up tables may be distributedamongst a variety of music services, a computing device may query eachmusic service simultaneously or sequentially in order to find a match.Other manners of identifying a suitable streaming service are possible.

In one implementation the identification of a streaming service at 708may further involve determining a currently available playback capacityof a streaming service that a user is registered with. Generally, somestreaming services may limit the number of active streams available fora registered account at any given time. For example, Spotify® may onlyallow a single active stream per a registered account. In one instance,a computing device may determine the currently available playbackcapacity by querying the services a user is registered with for a usagestatus (i.e. how many active streams) and then comparing the usagestatus to capacity restriction data (i.e. Spotify=1 active stream only).In another example, the streaming services may output a binary value inresponse to the query to indicate whether or not a stream is available.The available playback capacity may be determined in other ways.

In this implementation, the computing device at 708 may identify aregistered service as supporting the content type indicated by thecommand and further determine the registered service does not have astream available. For example, if a user and their spouse both share aSpotify® account and music is being streamed to the spouse's smartphonedevice at the gym when the user issues the command “Play Eye of theTiger,” the computing device may identify Spotify® as being able to playthe song and also that a stream is unavailable. Such a case may causethe computing device to identify another streaming service capable ofsupporting the content type, such as Apple Music®

In another instance, the computing device may be unable identify anotherstreaming service that may support the content type. This may occur forexample, if a user requests content exclusively provided by a singlestreaming service, the computing device only considers sub-set ofstreaming services, among other examples. In such an instance, thecomputing device may cause a currently active stream to be “stolen” foruse in providing the content corresponding to the command. Using theaforementioned, example if no other streaming service is capable ofsupporting “Eye of the Tiger,” the stream to spouse at the gym may becanceled and provided to the user.

In one instance, on the occurrence that an available streaming serviceis identified at 710 as capable of supporting the identified contenttype, the process may proceed to 714 to cause any combination of PBDs532-538 to playback the audio content. The music service may beaccessed, in one instance through querying the service API for contentand causing the content to be streamed. The audio content may bestreamed directly from computing device 508 or from various othercomputing devices associated with streaming music services directly toPBDs 532-538 upon a request from either PBDs 532-538 or computingdevices 504-506. Other ways of initiating and causing the playback ofstreaming media content also exist.

In another instance, if a streaming service identified at 710 is notpresently available (i.e. application not installed, user notregistered) a computing device may cause, at 714, the output of anindication pertaining to a suggestive course of action to enable themusic service to used. The indication may be sent any combination ofNMDs 512-516, PBDs 532-538, or CR 522 and may cause an audible and/orvisual suggestion indicating the identified music service capable ofsupporting the content type and/or present instructions on how to signup for, download, or otherwise utilize the music service.

FIG. 8 is another example flow diagram related to an example process foridentifying a streaming music service in blocks 710 and 712 of FIG. 6 .

At 802 a computing devices may cause a confidence metrics or metrics tobe determined for streaming service(s) based at least in part on thecontent type identified by the command. In general, a confidence metricmay be a numerical or percentage value (e.g. 1-100) calculated for astreaming service or services. Such confidence metric(s) may reflect thelikelihood that a selection of a particular music service for providingstreaming audio will result in providing the user with the content he orshe desires. For example, a streaming service assigned a confidencemetric of 80 may be more suitable for content provision than a streamingservice with a confidence metric of 45, where a higher number indicatesa higher confidence level of suitability.

The calculated confidence metrics for streaming services may be based ona number criterion such as content type, playback capacity, usagehistory, external data, among others. Such criteria may be constitutedby various data types and may be retrieved from various sources such asthe NMDs, CRs, PBDs, computing devices, music services, and variousexternal sources. The data may be aggregated and stored in a centrallocation such as a database associated with computing devices 504 or 506or in a distributed fashion.

In one instance, the confidence metric may take into account a streamingservice's suitability to support the content type indicated by acommand. Determining suitability of various streaming services toprovide a content type may involve mapping metadata relating to anidentified content type to a look-up table or querying the tables of thevarious music services and assigning a value to the number of fieldsthat match. As an example, a command that specifies “play Jackson 5playlist” may have the content type “Artist/playlist.” In such a case,the look-up table(s) of two streaming services such as Pandora® andSpotify® may both contain references to Jackson 5 in an artist field.However, only Spotify® may contain a playlist field identifying Jackson5, as Pandora® does not support the content type playlist. In such acase, Pandora® may be afforded content type value of 2 and Spotify® avalue of 1.

Additionally, or alternatively, strength of field matching may beemployed. Using the aforementioned example and assuming that theSpotify® service does not contain an artist field corresponding toJackson 5 but have artist entry for Michael Jackson, who may beidentified by a computing device utilizing music metadata as having beena former member of Jackson 5. In such, a case the Spotify® service maynot be given a value of 0 for the artist field, but rather the servicemay be afforded an adjusted value less than 1. Other forms ofdetermining streaming service content type suitability value arepossible.

In another instance, the confidence metrics may be calculated in part onvarious forms of historical usage data. The various historical datatypes may be retrieved from various sources such as the NMDs, CRs, PBDs,computing devices, music services, and various external sources. Thedata may be aggregated and stored in a central location such as adatabase associated with computing devices 504 or 506 or in adistributed fashion.

For example, the usage data may indicate how frequently a user accessesa given streaming service. As another example, the usage data mayinclude time based data to identify the service a user normally uses atvarious times of the day, days of the week, and months of the year. Forexample, a user may prefer to listen to iHeartRadio® in the morning andto Tidal® in the evenings. As another example, in a multi-zoneenvironment such usage data may indicate user preferences regardingstreaming services on a per zone basis. For example, if a user typicallyaccesses Spotify® 90% of the time in a bathroom zone and Deezer® 80% ofthe time in a living area zone the confidence metrics corresponding toSpotify® and Deezer® may vary significantly depending on which zone theuser intends to stream audio to. In such, a case if the user desired tolisten to music in the bathroom, Spotify® would be the much betterchoice. Various other types of historical usage data may exist as well.

Additionally, the confidence metrics may be determined in part based onvarious “external” data types. Such data may include macro type datathat may take into account geographic location or demographic data,among other possibilities. For example, such macro data may indicatethat a particular streaming service is not available or is unpopular incertain regions of the world or sub-regions of a country, which mayresult in a lower confidence metric. In such a case, the confidencemetric for that streaming service may vary dependent on the geographiclocation. Types of “external” data may further include weather data,which may be taken into account, for example a user's preference tolisten to Spotify® on the patio on cool, dry summer evenings.Additionally, calendar data may be considered to identify holidays andthe music service typically streamed on those days. Other forms ofexternal data may exist.

Furthermore, it is possible to combine the various criteria to determinea confidence metric for a given streaming service. For instance, a usermay prefer to use Pandora® to listen to a wide variety of classicalmusic in the living room but may exclusively use Apple Music® to listento full albums of their favorite artist in the bedroom. In such a case,content type(s) (genre, artist) may be combined with a user historyrelating to location of use of particular music services to determine aconfidence metric for a particular music service. Numerous othercombinations may exist.

A computer implemented algorithm may map the criterion described aboveto a confidence metric for streaming service. For instance, one or morecriterion may be mapped into a table which outputs the confidencemetric. In some embodiments, the algorithm may involve weighting ofvarious criteria such as content types, usage history, and/or “externaldata.” The algorithm may assign different weights to the variouscriteria based on relative importance. For example, a user preferencemay be deemed more influential and afforded more weight than demographicdata. The weighting of inputs may be defined by the system, by usersettings, or adjustable dynamically based on user feedback. Each ofweighted inputs may be input into a table, for example, for mapping toconfidence metrics which are then combined to form an aggregatedconfidence metric for a music service as a whole.

At 804 either computing device 504 or 506 may determine whether a givenstreaming service satisfies a confidence condition. The confidencecondition may be satisfied in a number of ways. In one instance, theconfidence condition may be satisfied if the confidence metric for agiven streaming service exceeds a confidence level threshold, which maybe a default system setting or adjustable by a user. For example, ifthree confidence metrics are calculated as Service1=85, Service2=83,Service3=25 with the threshold confidence level being 80, may causeService1 to be output for streaming or suggested to a user at 806 (asdiscussed above in reference to 714).

In another instance, the confidence condition may only be satisfied upon(1) a streaming service with a calculated confidence metric above thethreshold confidence level and (2) the two highest calculated confidencemetrics are not within a threshold range of one another. For example, ifthe confidence level range were 3 in the case mentioned directly abovethe confidence condition would not be satisfied due to confidencemetrics of Service1 and Service2. The confidence condition mayadditionally or alternatively incorporate various other rules.

At 808 an error state may be triggered by either computing device 504 or506 if the confidence condition is found not to be satisfied at 808. Anerror state may trigger certain events to be caused, such as outputtingan indication that the content is unavailable, as discussed in referenceto 716. In another instance, a triggered error state may cause contentto be streamed via a default streaming service or a preferred partnerservice. In yet another instance, the error state may cause a computingdevice to output an indication to one or all of NMDs 512-516, PBDs532-538, or CR 522 to cause an audible or visual presentation of aninstruction or query directed at obtaining more information in relationto the already received command.

In one instance, a user may be instructed to provide an additionalcontent type such as artist or album. For example, if an initial commandwere “Play radio station” a user may be instructed “Please providegenre.”

In another instance, a user may be asked a question or series ofquestions that may help further tune the initial command and thereby theconfidence metrics for the various streaming services. For example, ifan initial command were directed to the the broad genre of “Electronic,”the user may be asked whether they prefer certain sub-genres such as“Drum and Bass” or “Trance.” Additionally or alternatively, the user maybe asked questioned unrelated to music such as “What are you doing?” or“How do you feel?” to infer what sub-genre a user may want to listen to.For example, if the user answered “Reading” and/or “Relaxed” to theaforementioned questions it may be inferred that the user is interestedin the sub-genre Trance. Various other examples of queries are possible.

The user responses to the instructions or questions may take the form ofspeech input which may be received by an NMD or a textual input via agraphical interface of a CR. The user responses may cause process 700 torepeat which may result in the confidence condition being satisfied oran additional error state being triggered.

IV. CONCLUSION

The description above discloses, among other things, various examplesystems, methods, apparatus, and articles of manufacture including,among other components, firmware and/or software executed on hardware.It is understood that such examples are merely illustrative and shouldnot be considered as limiting. For example, it is contemplated that anyor all of the firmware, hardware, and/or software aspects or componentscan be embodied exclusively in hardware, exclusively in software,exclusively in firmware, or in any combination of hardware, software,and/or firmware. Accordingly, the examples provided are not the onlyway(s) to implement such systems, methods, apparatus, and/or articles ofmanufacture.

Additionally, references herein to “embodiment” means that a particularfeature, structure, or characteristic described in connection with theembodiment can be included in at least one example embodiment of aninvention. The appearances of this phrase in various places in thespecification are not necessarily all referring to the same embodiment,nor are separate or alternative embodiments mutually exclusive of otherembodiments. As such, the embodiments described herein, explicitly andimplicitly understood by one skilled in the art, can be combined withother embodiments.

The specification is presented largely in terms of illustrativeenvironments, systems, procedures, steps, logic blocks, processing, andother symbolic representations that directly or indirectly resemble theoperations of data processing devices coupled to networks. These processdescriptions and representations are typically used by those skilled inthe art to most effectively convey the substance of their work to othersskilled in the art. Numerous specific details are set forth to provide athorough understanding of the present disclosure. However, it isunderstood to those skilled in the art that certain embodiments of thepresent disclosure can be practiced without certain, specific details.In other instances, well known methods, procedures, components, andcircuitry have not been described in detail to avoid unnecessarilyobscuring aspects of the embodiments. Accordingly, the scope of thepresent disclosure is defined by the appended claims rather than theforgoing description of embodiments.

When any of the appended claims are read to cover a purely softwareand/or firmware implementation, at least one of the elements in at leastone example is hereby expressly defined to include a tangible,non-transitory medium such as a memory, DVD, CD, Blu-ray, and so on,storing the software and/or firmware.

The invention claimed is:
 1. A network device comprising: a networkinterface; at least one processor; non-transitory computer-readablemedium; and program instructions stored on the non-transitorycomputer-readable medium that are executable by the at least oneprocessor such that the network device is configured to: receive, viathe network interface, (i) data indicating a request for audio content,wherein the request for audio content is based on a voice utterance, and(ii) data indicating a particular playback device for playback of therequested audio content from among at least a first playback device anda second playback device of a media playback system, wherein each of thefirst playback device and the second playback device is programmed withthe capability to receive and play back audio content from either afirst music service provider or a second music service provider; parsethe data indicating the request for audio content to identify at least asegment of data indicating a content identification; select one of thefirst music service provider or the second music service provider basedon the data indicating the particular playback device, wherein selectingone of the first music service provider or the second music serviceprovider comprises: determining a first confidence metric correspondingto the first music service provider and a second confidence metriccorresponding to the second music service provider, wherein the firstconfidence metric is based on a history of accesses to the first musicservice provider by the particular playback device and wherein thesecond confidence metric is based on a history of accesses to the secondmusic service provider by the particular playback device; determiningthat a given one of the first confidence metric or the second confidencemetric better satisfies a confidence condition; and selecting whicheverone of the first music service provider or the second music serviceprovider corresponds to the given one of the first confidence metric orthe second confidence metric; after selecting the one of the first musicservice provider or the second music service provider, identify auniform resource identifier corresponding to the content identificationand the selected one of the first music service provider or the secondmusic service provider; and transmit, via the network interface to theparticular playback device, the uniform resource identifier to cause theparticular playback device to retrieve audio content from the selectedone of the first music service provider or the second music serviceprovider according to the uniform resource identifier.
 2. The networkdevice of claim 1, wherein the media playback system comprises aplurality of playback zones, wherein a first playback zone of theplurality of playback zones comprises the first playback device, andwherein a second playback zone of the plurality of playback zonescomprises the second playback device.
 3. The network device of claim 1,further comprising program instructions stored on the non-transitorycomputer-readable medium that are executable by the at least oneprocessor such that the network device is configured to: receive, viathe network interface, data indicating the second music service, whereinthe second confidence metric is further based on the data indicating thesecond music service.
 4. The network device of claim 1, furthercomprising: one or more microphones; and program instructions stored onthe non-transitory computer-readable medium that are executable by theat least one processor such that the network device is configured toreceive the voice utterance via the one or more microphones.
 5. Thenetwork device of claim 1, wherein the network device comprises thefirst playback device.
 6. The network device of claim 1, wherein: theprogram instructions that are executable by the at least one processorsuch that the network device is configured to determine that the givenone of the first confidence metric or the second confidence metricbetter satisfies the confidence condition comprise program instructionsthat are executable by the at least one processor such that the networkdevice is configured to: determine that one of the first confidencemetric or the second confidence metric has a higher value; and theprogram instructions that are executable by the at least one processorsuch that the network device is configured to select whichever one ofthe first music service provider or the second music service providercorresponds to the given one of the first confidence metric or thesecond confidence metric comprise program instructions that areexecutable by the at least one processor such that the network device isconfigured to: select whichever one of the first music service provideror the second music service provider corresponds to the given one of thefirst confidence metric or the second confidence metric having thehigher value.
 7. The network device of claim 1, wherein the contentidentification indicates one or more of an of artist, genre, song, oralbum of the requested audio content.
 8. The network device of claim 1,wherein the voice utterance indicates the particular playback device. 9.The network device of claim 1, wherein: the program instructions thatare executable by the at least one processor such that the networkdevice is configured to determine that the given one of the firstconfidence metric or the second confidence metric better satisfies theconfidence condition comprise program instructions that are executableby the at least one processor such that the network device is configuredto: determine that the given one of the first confidence metric or thesecond confidence metric exceeds a confidence level threshold; and theprogram instructions that are executable by the at least one processorsuch that the network device is configured to select whichever one ofthe first music service provider or the second music service providercorresponds to the given one of the first confidence metric or thesecond confidence metric comprise program instructions that areexecutable by the at least one processor such that the network device isconfigured to: select whichever one of the first music service provideror the second music service provider corresponds to the given one of thefirst confidence metric or the second confidence metric that exceeds theconfidence level threshold.
 10. The network device of claim 9, furthercomprising program instructions stored on the non-transitorycomputer-readable medium that are executable by the at least oneprocessor such that the network device is configured to: in response todetermining that one of the first confidence metric or the secondconfidence metric exceeds the confidence level threshold, determine thata difference between the first confidence metric and the secondconfidence metric is outside of a predetermined range; and in responseto determining that the difference between the first confidence metricand the second confidence metric is outside of the predetermined range,select the given one of the first music service provider or the secondmusic service provider that exceeds the confidence level threshold. 11.The network device of claim 9, wherein the confidence level threshold isone of (i) a default system setting or (ii) adjustable by a user.
 12. Amethod carried out by a network device, the method comprising:receiving, via a network interface of the network device, (i) dataindicating a request for audio content, wherein the request for audiocontent is based on a voice utterance, and (ii) data indicating aparticular playback device for playback of the requested audio contentfrom among at least a first playback device and a second playback deviceof a media playback system, wherein each of the first playback deviceand the second playback device is programmed with the capability toreceive and play back audio content from either a first music serviceprovider or a second music service provider; parsing the data indicatingthe request for audio content to identify at least a segment of dataindicating a content identification; selecting one of the first musicservice provider or the second music service provider based on theindicated particular playback device, wherein selecting one of the firstmusic service provider or the second music service provider comprises:determining a first confidence metric corresponding to the first musicservice provider and a second confidence metric corresponding to thesecond music service provider, wherein the first confidence metric isbased on a history of accesses to the first music service provider bythe particular playback device and wherein the second confidence metricis based on a history of accesses to the second music service providerby the particular playback device; determining that a given one of thefirst confidence metric or the second confidence metric better satisfiesa confidence condition; and selecting whichever one of the first musicservice provider or the second music service provider corresponds to thegiven one of the first confidence metric or the second confidencemetric; after selecting the one of the first music service provider orthe second music service provider, identifying a uniform resourceidentifier corresponding to the content identification and the selectedone of the first music service provider or the second music serviceprovider; and transmitting, via the network interface to the particularplayback device, the uniform resource identifier to cause the particularplayback device to retrieve audio content from the selected one of thefirst music service provider or the second music service provideraccording to the uniform resource identifier.
 13. The method of claim12, wherein the media playback system comprises a plurality of playbackzones, wherein a first playback zone of the plurality of playback zonescomprises the first playback device, and wherein a second playback zoneof the plurality of playback zones comprises the second playback device.14. The method of claim 12, further comprising: receiving, via thenetwork interface, data indicating the second music service, wherein thesecond confidence metric is further based on the data indicating thesecond music service.
 15. The method of claim 12, wherein the networkdevice comprises the first playback device.
 16. The method of claim 12,wherein determining that the given one of the first confidence metric orthe second confidence metric better satisfies the confidence conditioncomprises: determining that the given one of the first confidence metricor the second confidence metric exceeds a confidence level threshold;and wherein selecting whichever one of the first music service provideror the second music service provider corresponds to the given one of thefirst confidence metric or the second confidence metric comprises:selecting whichever one of the first music service provider or thesecond music service provider corresponds to the given one of the firstconfidence metric or the second confidence metric that exceeds theconfidence level threshold.
 17. The method of claim 16, furthercomprising: in response to determining that one of the first confidencemetric or the second confidence metric exceeds the confidence levelthreshold, determining that a difference between the first confidencemetric and the second confidence metric is outside of a predeterminedrange; and in response to determining that the difference between thefirst confidence metric and the second confidence metric is outside ofthe predetermined range, selecting the given one of the first musicservice provider or the second music service provider that exceeds theconfidence level threshold.
 18. The method of claim 16, wherein theconfidence level threshold is one of (i) a default system setting or(ii) adjustable by a user.
 19. A non-transitory computer-readablemedium, wherein the non-transitory computer-readable medium isprovisioned with program instructions that, when executed by at leastone processor, cause a network device to: receive, via a networkinterface of the network device, (i) data indicating a request for audiocontent, wherein the request for audio content is based on a voiceutterance, and (ii) data indicating a particular playback device forplayback of the requested audio content from among at least a firstplayback device and a second playback device of a media playback system,wherein each of the first playback device and the second playback deviceis programmed with the capability to receive and play back audio contentfrom either a first music service provider or a second music serviceprovider; parse the data indicating the request for audio content toidentify at least a segment of data indicating a content identification;select one of the first music service provider or the second musicservice provider based on the data indicating the particular playbackdevice, wherein selecting one of the first music service provider or thesecond music service provider comprises: determining a first confidencemetric corresponding to the first music service provider and a secondconfidence metric corresponding to the second music service provider,wherein the first confidence metric is based on a history of accesses tothe first music service provider by the particular playback device andwherein the second confidence metric is based on a history of accessesto the second music service provider by the particular playback device;determining that a given one of the first confidence metric or thesecond confidence metric better satisfies a confidence condition; andselecting whichever one of the first music service provider or thesecond music service provider corresponds to the given one of the firstconfidence metric or the second confidence metric; after selecting theone of the first music service provider or the second music serviceprovider, identify a uniform resource identifier corresponding to thecontent identification and the selected one of the first music serviceprovider or the second music service provider; and transmit, via thenetwork interface to the particular playback device, the uniformresource identifier to cause the particular playback device to retrieveaudio content from the selected one of the first music service provideror the second music service provider according to the uniform resourceidentifier.
 20. The non-transitory computer-readable medium of claim 19,wherein the non-transitory computer-readable medium is also provisionedwith program instructions that, when executed by at least one processor,cause the network device to: receive, via the network interface, dataindicating the second music service, wherein the second confidencemetric is further based on the data indicating the second music service.